A NOTE ON COLUMN SUBSET SELECTION 
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ABSTRACT. Given a matrix J7, using a deterministic method, we extract a "large" submatrix of 
U (whose columns are obtained by normalizing those of U) and estimate its smallest and largest 
singular value. We apply this result to the study of contact points of the unit ball with its maximal 
volume ellipsoid. We consider also the paving problem and give a deterministic algorithm to 
partition a matrix into almost isometric blocks recovering previous results of Bourgain-Tzafriri 
and Tropp. Finally, we partially answer a question raised by Naor about finding an algorithm in 
the spirit of Batson-Spielman-Srivastava's work to extract a "large" square submatrix of "small" 
norm. 



1. Introduction 
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Let U a n x m matrix, the stable rank of U is given by srank(U) = ijjjffi > where 
Tr ([/£/*) denotes the Hilbert-Schmidt norm of U and \\U\\ 2 the operator norm of U seen as an 



operator from I™ to 1%. Denoting U the matrix whose columns are obtained by normalizing 
those of U, our aim is to extract almost srank{U) number of linearly independent columns of 
U and estimate the smallest and the largest singular value of the restricted matrix. 

This problem is closely related to the restricted invertibility where only an estimate on the 
smallest singular value is needed. The restricted invertibility was first studied by Bourgain- 
Tzafriri El who proved the following: 

Theorem A. Given an n x n matrix T whose columns are of norm one, there exists a C 
{1, . . .,n} with \o~\ ^ ^tpfp" sucn that \\T a x\\2 ^ c||x|| 2 for all x G W 7 , where d,c > are 

II-' lb 

absolute constants and T a denotes the restriction ofT onto the columns in a. 

In lfT5l . Vershynin extended this result for any decomposition of the identity, whereas the 
previous result was valid for the canonical decomposition. Moreover the size of the restric- 
tion depended on the Hilbert-Schmidt norm of the operator. Precisely, Vershynin proved the 
following: 

Theorem B. Let Id = J2j 

^ m XjX 1 , and let T be a linear operator on For any e G (0, 1) one 
can find ad {!,..., m} with 



ITII 2 

\ 1 II HS 

IITII 2 
ll J 112 



such that 



for all scalars 



c e 



TXj 



Vershynin applied this result to the study of contact points. The normalization on the vectors 
Txj is crucial for the applications and the dependence on e plays an important role. Spielman- 
Srivastava IfTTll generalized the restricted invertibility principle (Theorem A) for any decom- 
position of the identity without the normalizing factors appearing in Vershynin's result and 
improved the dependence on e. In IfToll . we unified the two previous results obtaining a good 
dependence on e for any normalizing factors. However this result deals only with the lower 
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bound and doesn't give any information on the norm of the restricted matrix. Our aim here, is 
to improve Vershynin's result obtaining simultaneously a restricted invertibility principle and 
an estimate on the norm of the restricted matrix. Our proof uses ideas of the method of Batson- 
Spielman-Srivastava (HI, lfT2l . see also IfToTl for related topics). 



The main result of this paper is the following: 

Theorem 1.1. Let U be an n x m matrix and denote by U the matrix whose columns are the 
columns ofU normalized. For all e < 1, there exists a C {1, m} of size 



(T 



JIW 2 

2\\ u II HS 



such that 



2-e 

In other terms, for all (aj)j gcr 



2-e 




jgcr II JU* 
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Note that the lower bound problem is the restricted invertibility problem treated in IfTTI and 
lfT6l while the upper bound problem is related to the sparsification method and the Kashin- 
Tzafriri column selection theorem [8] treated respectively in [Q]| and IfToll . Our idea is to merge 
the two algorithms together to get the two conclusions simultaneously. The heart of these 
methods is the study of the evolution of the eigenvalues of a matrix when perturbated by a rank 
one matrix. 

In the regime where e is close to one, the previous result yields the following: 

Corollary 1.2. Let U be an n x m matrix and denote by U the matrix whose columns are the 
columns ofU normalized. For all e < 1, there exists a C {1, m} of size 

ki >. e2 l|f/|li 



Ihs 



such that 



9' \\U\\- 



1 - e < s min (U a ) ^ s max (U a ) ^1 + e 



In other terms, for all (a,j)jea 




Where (e 



\Ue 



il|2 



denotes the canonical basis of] 



^ a 



This result is also related to the problem of column paving that is partitioning the columns 
into sets such that each of the corresponding restrictions has "good" bounds on the singular 
values, in particular such that the singular values are close to one. We will show how our Theo- 
rem allows us to recover a result of Tropp lfT4l (and of Bourgain-Tzafriri [2]) dealing with this 
problem, using our deterministic method instead of the probabilistic methods used previously. 



In a survey [0 on Batson-Spielman-Srivastava's sparsification theorem, Naor asked about 
giving a proof of another theorem of Bourgain-Tzafriri [0, which is stronger than the restricted 
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invertibility, using tools from Batson-Spielman-Srivastava's method. The theorem in question 
is the following: 

Theorem C (Bourgain-Tzafriri). There is a universal constant c > such that for every e < 1 
and n G N if an operator T : W 1 — > M. n satisfies {Tei, e^) = for all i G {1, . . . , n} then 
there exists a subset a C {1, . . . , n} satisfying \a\ ^ ce 2 n and \\RaTR* || ^ s\\T\\ . 

Using our result, we will be able to give a deterministic algorithm to solve this problem for 
symmetric matrices. 

The paper is organized as follows: in section 2, we prove our main result, in section 3 we 
give applications to the local theory of Banach spaces and compare it with Vershynin's result. 
In section 4, we prove column paving results and finally in section 5 we answer Naor's question. 



2. Proof of Theorem I1.1I 
Note k = \a\ = (1 - ^) 2 ^t^ and 

where Sj are positive numbers which will be determined later. Since our aim is to find a such 
that the smallest singular value of U a is bounded away from zero and its largest one is up- 
per bounded, it is equivalent to try to construct the matrix A k such that A k has k eigenvalues 
bounded away from zero and bounded from above and to estimate the weights Sj. Our construc- 
tion will be done step by step starting from A = 0. So at the beginning, all the eigenvalues of 
A are zero. At the first step we will try to find a vector v among the columns of U and a weight 
s such that Ai = A + svv 1 has one nonzero eigenvalue which have a lower and upper bound. 
Of course the first step is trivial, since for whatever column we choose the matrix A\ will have 
one eigenvalue equal to s. At the second step, we will try to find a vector v among the columns 
of U and a weight s such that A 2 = A\ + svv 1 has two nonzero eigenvalues for which we can 
update the lower and upper bound found in the first step. We will continue this procedure until 
we construct the matrix A k . 



For a symmetric matrix A such that b < \ m m{A) ^ A max (v4) < u, we define: 

<f)(A,b) =Tt(u 1 (A-b.Id)~ l u) and ip(A, u) = Tr (U* (u.Id - Ay 1 U 

For I ^ k, we denote by bi the lower bound of the I nonzero eigenvalues of Ai and by ui the 
upper bound i.e A\ -< u^.ld and has I eigenvalues > fy. We also note 

= 0(A,M = -^r^ and ^ = ^A ,u ) = ^^, 
bo uq 

where b and u will be determined later. 

As we said before, we want to control the evolution of the eigenvalues so we will make sure 
to choose a "good" vector so that our bounds bi and u\ do not move too far. Precisely, we will 
fix this amount of change and denote it by 5 for the lower bound and A for the upper bound i.e 
at the next step the lower bound will be bi + i = b[ — 5 and the upper one ui + i — ui + A. We will 
choose these two quantities as follows: 



A M^H A a r-i n m o uo\\U 

£)-r = tz \ no and A = (1 — e 



k (1 ~ e)\\U\\l s " 'k {l-e)\\U\\l s 
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Our choice of 8 is motivated by the fact that after k steps we want the updated lower bound to 
remain positive but not too small due to some obstructions in the proof. In this case the final 
lower bound will be 

b k = b k -i - 5 = ... = b - kS = eb 

The choice of A is motivated by the fact that we don't want the upper bound to move too far 
from the initial one and as for 5 we have some obstruction on taking its value too small. The 
final upper bound will be 

u k = u k _i + A = ... = uq + kA = (2 — e)u 

Definition 2.1. We will say that a positive semidefinite matrix A satisfies the I -requirement if 
the following properties are verified: 

• A -< ui.ld. 

• A has I eigenvalues > fy. 

• <f>{A, k) <: 0. 

• ip(A,ui) < ip. 

In order to construct A i+ i which has I + 1 nonzero eigenvalues larger than and such 
that (j)(Ai + i, ^ (f>(Ai, bi), we may look at the algorithm used for the restricted invertibility 
problem ( ifTTIl . lfT6lO and more precisely, at the condition needed on the vector v to be chosen: 

Lemma 2.2. If Ai has I nonzero eigenvalues greater than bi and if for some vector v and some 
positive scalar s we have 

4>{Ai,bi) - 4>{A h bi +1 ) s 

Then A i+1 = A\ + svv f has I + 1 nonzero eigenvalues all greater than b [+1 and bi+i) ^ 

(piAuk). 

Now, in order to construct A[ + i which has all its eigenvalues smaller than ui + i and such that 
ijj(Ai + i, ui + i) ^ ip(Ai, ui) we may look at the algorithm used for the sparsification theorem [Q]| 
or the Kashin-Tzafriri column selection theorem (see Theorem 4.2 IfTolO : 

Lemma 2.3. If ' A\ -< ui.ld and if for some vector v and some positive scalar s we have 

(2) := ;' (^l+ V /t '7^' ^2l, , ■ WUf + v< (u m .U - A,)'' v < i. 

ip{A u ui) - ifj(Ai,ui+i) s 

Then denoting A i+ i = A t + svv 1 , we have A i+1 -< u l+ i.Id and tjj(Ai + i, itj+i) ^ ij)(Ai, u{). 

The proof of these two lemmas makes use of the Sherman-Morrison formula. 

For our problem, we will need to find a vector v satisfying (OQ) and © simultaneously. For 
that we need to merge these two conditions in one equation: 

Lemma 2.4. If Ai -< ui.ld has I eigenvalues greater than b\ and if for some vector v we have 

(3) F t (v) ^ Gi(v) 

Then taking any s such that Fi(v) ^ - ^ Gi(v), then Ai + i = Ai + svv* satisfies the (I + 1)- 
requirement. 

Remark 2.5. Since Ai + \ has I + 1 nonzero eigenvalues while Ai had only I nonzero eigenvalues, 
then the vector v chosen is linearly independent with the eigenvectors of ' A\. Therefore one can 
see thatKer(A l+ i) C Ker(Ai) and Dim [Ker(Ai+i)] = Dim [Ker(Ai)] - 1. 



Proposition 2.6. Let A\ satisfying the l-requirement. If bo and uq satisfy 

eu 



(4) 



b n < 



then there exists i ^ m and a positive number s.- L such that Ai+\ = A[ + Sj (Ueij ■ [TJei 
satisfies the {I + l)-requirement. 

Proof. According to Lemma 1241 it is sufficient to find % ^ m such that Fi {UeA ^ Gi (tie 
and then take such that 



5 j 



(5) 



Since and are quadratic forms, it is equivalent to find i ^ m such that Fi (Uei) ^ Gi (Uei 
For that, it is sufficient to prove 



(6) 



Before estimating J2j^ m Fi(Uej), let us note that 

ii(A h ui) - i/j(A u u,+i) = Tr {U* ( Ul .Id - A)' 1 U 



Tr 



= ATr 
> ATr 



IT* ( Uf .Jd - y^r 1 (M l+ i.Jd - A,)" 1 U 



u l { Ul+1 .id-A l y 2 u 



Replacing this in F t we get 



E F i 



Ei<m e 7^' ( U l+1- Id ~ A l) 2Ue i 



Tr 



ijj(A h ui) - ip(A h ui +1 ) 



U l {u l+1 .Id-A l y 2 U 



i/j(A u ui) - ip(A h ui +1 ) 
\U\\ 2 



\U\r + Tr 



13 e*C7* {u l+1 .Id-A l y 1 Ue j 



u l (m+t.id-A^u 



A 



Now we may estimate J2j<: m Gi (Uej). We denote by Pi the orthogonal projection onto the 
image of A\ and Q\ the orthogonal projection onto the kernel of A[. Note that V/ ^ k we have 
the following 



(7) 



k<8 



WQiUWh 



Since Q = Id, this fact is true at the beginning by our choice of 5. Taking in account Re- 
mark [231 at each step ||Q/^||hs decreases by at most \\U\\ 2 so that the right hand side of CO) 
decreases by at most 5. Since at each step we replace 6/ by h+i, © remains true. 
Since Id= Pi + Qi and P^Qu Ai commute we can write 



Tr 



TP (A t -b l+1 .Idy 2 U 



Tr 
Tr 



U t P l {A l -b l+1 .Id)- 2 P l U 

u'p^A-b^.idy'm 



Tr 



TJ t Q l {A l -b l+l .Id)~ 2 Q l U 



worn 

bf +1 



us 
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Doing the same decomposition for <pi(A{) we get 



(j){A h k) = Tr lU'Pt (At - h.Id)- 1 PiU] + Tr ft^Q, (A t - 6,. Id) -1 Q,c/ 



Tr 



Utp^At-k.Id)- 1 ^!/ 



\\QiU\\ 



us 



:= p (4,&,) + g (4,&i) 

Denote A; = 6/) — h + i) and Af , A^ the corresponding decompositions onto the 

image part and the kernel part as above. As we did before, we have A; = Af + Af and 



Af = Tr 
= 5Ti 
> 5Tr 



Tr 



u'PdA-k.idy'm 

~U t P l (A t - k.Idy 1 (At - b l+1 .Idy x PU 
C7*fl(^-6 /+ i./d)- 3 W 



u'p^A-b^.idy'pu 



Using © we have 



a; 



Q 



\\QiU\\ 2 n S , \\QiU\\l s SWQVWSa W\\ 2 



+i 



bib 



k+i 



Looking at the previous information, we can write 



E Gi (Ue 



Tr 



U l (A l -b l+l .Idy 2 U 



A, 



||f/|| 2 -Tr[^ (A-b^.Idy'U 



Tr 



u t p l (A l -b l+1 .idy 2 p l u 



H 6? 



A, 



<Pi+i{Ai) 



Af , ^IIQiC/ll 



hh+i 



'i+i 



A, 



5 + A i 



1 + - J - 



A* 

2 II r r 1 1 2 



. \\U\\ 2 + A t - U^i) 
\\U\\ 2 + A? - 4 



$ k+i 

2 



A? 



6 



\\U\\ : 



Until now we have proven that 
E Gi (Ue 3 ) > - 
So in order to prove ©, it will be sufficient to verify 

12 II7VII2 



and J2 F i ( Ue j) < 



A 



(8) 



+ < 



A 5 

Replacing in ([8]) the values of the corresponding parameters as chosen at the beginning, it is 
sufficient to prove 



u 6 



which is after rearrangement condition ©. 



□ 
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Keeping in mind that k — (1 — e) 2 y J|p s > we are ready to finish the construction of A^. We 



may iterate Proposition l2.6l starting with A = 0. Of course, A satisfies the 0-requirement so by 
the proposition we can find a column vector and a corresponding scalar to form A\ satisfying the 
1 -requirement. Once again we use the proposition to construct A 2 satisfying the 2 -requirement. 
We can continue with this procedure as long as the corresponding lower bound bi is positve 

(which is the case for b k ). So after k steps we have constructed A k = s j (Ue^j ■ {UeA 
satisfying the ^-requirement which means that 

A k -< u k .Id = (1 — 2e)uv and A k has k eigenvalues bigger than b k = eb . 

Now it remains to estimate the weights Sj chosen. This will be done by a trivial calculation: 

Lemma 2.7. For any I ^ k and any unit vector v we have 

GiM ^ -r and FAv) ^ 



eb (2 - e)u 



Proof. Write again/d = Pt+Qt and notice that ^g^jg-Ji and v i P l (At - 6,+i.Jd)" 1 Pv 
are positive then we have 

Gi(v) ^ -v* (A l - b l+1 .Idy l v ^ -w*Q, (Ai - b l+x .Idy x Qtv ^ < ^ < 



b k ~~ ebo 



Now since t^t^ \ > then 

ip(A l ,u l )-if!(Ai,ui +1 ) ^ 



F^^v^u^.Id-At) 1 v>v t (u k .Id) x v> 



(2 - e)u 

The weights Sj that we have chosen satisfied © and therefore by the previous lemma 

Wi ^ k, eb Q ^ s j ^ (2 — s)u 
Back to our problem note that 

t 



□ 



U'Vt = E (Vet) ■ (Ue, 



and therefore 



(2 - e)u (2 - e)u f£ J y ' v ' eb f£ J ^ ' \ / e6 

!-e)t 



values greater than — . 
This means that 



Transfering the properties of A k , we deduce that U a U l a < { ^^Id and U a U* has ft eigen- 



£b o tj ^ T~Tt T ~T ^ (2-e)«o 



(2-e)uo " a eb 
Taking b = in order to satsify © we finish the proof of Theorem ll.il 

3. Application to the local theory of Banach spaces 

As for the restricted invertibility principle where one can interpret the result as the invert- 
ibility of an operator on a decomposition of the identity, we will write the result in terms of a 
decomposition of the identity. This will be useful for applications to the local theory of Banach 
spaces since by John's theorem Q one can have a decomposition of the identity formed by 
contact points of the unit ball with its maximal volume ellipsoid. 
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Proposition 3.1. Let Id = J2i^ m y%y\ be a decomposition of the identity in W 1 and T be a linear 
operator on 1%. For e < 1, there exists a C {1, m} such that 

\<t\ > (I 



IITII 2 

\2 W 1 II HS 



T 



and for all (a,j)j^k, 



e 



ftk 3 \\ T Vih 




Proof. Let U be the n x m matrix whose columns are Tyj. Therefore we can write 



UU* = £ (T Vj ) ■ {Ty 3 



We deduce that ||J7||hs 
a C {1, m} such that 



and for all (%)j- eiT , 



\T\ 



us 



and 



\a\ > fl 



|T||. Applying Theorem 11.11 to U, we find 



IITII 2 

^2 II 1 II HS 
||T|| 2 



Noting that 




° II Ue, || 2 



f7e,|| 2 



\\TVjh 



, we finish the proof. 



□ 



This result improves the dependence on e in comparison with Vershynin's result 11151 . While 
Vershynin proved that (Tyj)j £a is c(e) -equivalent to an orthogonal basis, the value of c(e) was 
of the order of £~ clo s( e ). Here our sequence is (4e~ 2 )-equivalent to an orthogonal basis. 

In the regime where e is close to one, the previous proposition yields the following: 



Corollary 3.2. Let Id = Yli^m Villi a decomposition of the identity in 
operator on l"^. For e < 1, there exists a C {1, m} such that 



l n and T a linear 



e 2 \\T\ 



us 



and for all (ojOjscfc, 



E% 



9 T 



\\Ty. 



J 1 1 2 



Es 2 



The two previous results can be written in terms of contact points, let us for instance write 
the case of T = Id. If X = (M n , || • ||) where || • || is a norm on R n such that B% is the 
ellipsoid of maximal volume contained in B x , then by John's theorem one can get an identity 
decomposition formed by contact points of B x with B%. Applying Proposition 13 . 1 1 we get the 
following: 

Proposition 3.3. Let X = (W 1 , || ■ || ) where || • || is a norm on M. n such that B% is the ellipsoid of 
maximal volume contained in Bx- For e < 1, there exists xi,...,Xk contact points of Bx with 
B% such that 

k ^ (1 - efn 



9 



and for all (oj)j^fo 



£% 



In other terms, we can find a system of almost n contact points which is (4^~ 2 ) -equivalent to 
an orthonormal basis. Looking at the lower bound, this gives a proportional Dvoretzky-Rogers 
factorization |6l with the best known dependence on e. 

If we are willing to give up on the fact of extracting a large number of contact points, we can 
have a system of contact points which is (1 + e) -equivalent to an orthonormal basis. For that 
we write the previous proposition in the regime where e is close to 1. 

Corollary 3.4. Let X = (M™, || • ||) where || ■ || is a norm on M n such that B^ is the ellipsoid of 
maximal volume contained in Bx- For e < 1, there exists x±, Xk contact points of Bx with 



£?2 such that 



and for all (aj)j^k, 



k > 



e 2 n 











)'« 


£ a j x j 










2 


W ) 



£< 

Applying proposition [33] we get the following corollary: 

Corollary 3.5. Let X = (IR n , || ■ ||) where \\ ■ \\ is a norm on R n such that B% is the ellipsoid 
of maximal volume contained in Bx- For e < 1, there exists xi,...,x/~ linearly independent 
contact points of Bx with B2 such that 



k > (V2-i)V 



n 



and for any i ^ k, 

Proof. Let e < 1 and denote a = (\/2 — l) 2 . Apply proposition 13.31 with (1 — as) in order to 
find a system of linearly independent contact points {xj)j^k such that 



Ai 



£ x j x j — y y 



as 



— as 



For i ^ k, 



Id 



(A k Xi, x^ = 1 + J2 (xj, Xi} 2 < (tz~) 
The conclusion follows by a trivial calculation. 

4. Column paving 



□ 



Extracting a large column submatrix reveals to be useful since the extracted matrix may have 
better properties. One can also be interested in partitioning the matrix into disjoint sets of 
columns such that each block has "good" properties. Obtaining a constant number of blocks 
(independent of the dimension) turns out to be a difficult problem and many conjectures con- 
cerning this were given previously (see flU). 

The previous algorithms for extraction used probabilistic arguments and Grothendieck's fac- 
torization theorem. Here we propose a deterministic algorithm to achieve the extraction, we 
apply our main result iteratively in order to partition the matrix into blocks on each of them we 
have good estimates on the singular values. 
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Definition 4.1. Let U a n x m matrix. We will say that U is standardized if all its columns are 
of norm 1. 

Note that when U is standardized we have ||£7||hs = m an d ||^|| ^ 1- Applying Theorem ll.il 
to a standardized matrix, we get the following proposition: 

Proposition 4.2. Let U a n x m standardized matrix. For e < 1, there exists a C {1, m} 
with 

(1 — e) 2 m 

such that 

e 2 — e 

7T^— ^ S min (U a ) ^ S max (U a ) < 

In the regime where e is close to one, the previous proposition yields an almost isometric 
estimation: 



Corollary 4.3. Let U an x m standardized matrix. Fore < 1, there exists a C {1, m} with 
such that 

1 - £ < S min (£/" CT ) ^ S max (U a ) ^ 1 + £ 

Proposition 4.4. Le? U a n x m standardized matrix. For e < 1, f/?ere emto a partition of 
{1, m} mto p seta ai, a p smc/? that 

U\\ 2 log(m) 



P 



(1-ey 
and for any i ^ p, 



e 2 — e 



2\ •-'HULL V V-%J ^ "IIlfcLX. \ Ui/ \ 

Proof. Apply Proposition [4T2] to U in order to get u\ verifying 

Wi > , m 



such that ^ 

Now note that [T^c is a n x | cr x | standardized matrix and \\U a c || ^ || U\\ and apply Proposition l4.2l 
to U a c in order to get a 2 C ctJ verifying 

) 2 , 

|2~l"ll 



°2 = riTTTio °1 ' 



\\U\\ 2 1 11 \\U\\' 



m 



Doing this procedure p times, the number of remaining columns is 

('-if) m 

So in order to cover all the columns, we need to take p such that 

1 - V „„„„ TO < 1 



By a trivial calculation, it is sufficient to take (i_°)2 blocks. □ 
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In the regime where e is close to one, the previous proposition yields a column partition 
with almost isometric blocks. This recovers a result of Tropp (see Theorem 1.2 in lQ"4lO . which 
follows results of Bourgain-Tzafriri O, with a deterministic method. 

Corollary 4.5. Let U a n x m standardized matrix. For e < 1, there exists a partition of 
{1, m} into p sets a±, cr p such that 

9\\U\\ 2 \og(m) 

P < 5 

e 2 

and for any i ^ p, 

1 - e < s min (J7 CT J ^ s max (C^.) < 1 + £ 

The number of blocks here depends on the dimension. The challenging problem is to partition 
into a number of blocks which does not depend on the dimension. This would give a positive 
solution to the paving conjecture (see H for related problems). 

5. Extracting square submatrix with small norm 

In this section, we will show how using our main result we can answer Naor's question 
find an algorithm, using the Batson-Spielman-Srivastava's method [1], to prove Theorem C 0. 
However, we will be able to do this only for symmetric matrices. 

Proposition 5.1. Let T a n x n symmetric matrix with diagonal. For any e < 1, there exists 
a C {1, n} of size 



2 



such that 

\\P a TP*\\ < e||T|| 

Proof. Denote A = T + ||T|| .Id, then A is a positive semidefinite symmetric matrix so we may 
take U = A? . First note that since T has diagonal then 

\\Uei\\l = (Uei,Uei) = (Ae^e^ = ||T|| 

Therefore U = — ^t- is a standardized matrix. Moreover \\U\\ 2 = 2. 

\\T\\2 

Denote a = (\^2 — l) 2 and apply Proposition 14.21 with 1 — as to find a C {1, n} of size 



^#2 such that 



This means that 



J^/" (ft)* ■(*)=< 

Recall that f/ CT = UP* and [/* • U = ^ . Therefore by the choice of a 

(1 -e)\\T\\.Id a r< P a AP CT * r< (l + e)||T||.7d ff 
which after rearrangement gives 

-e\\T\\ ■< PaTP* r< e||T|| 
and finishes the proof. □ 

Iterating the previous result, we obtain by a deterministic method the strongest result on the 
paving problem which is due to Bourgain-Tzafriri ([0, see also lfT3T0 that is every zero-diagonal 
matrix of size n x n can be paved with at most 0(log(n)) blocks. Once again, we are able to 
achieve this for symmetric matrices. 
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Proposition 5.2. Let T a n x n symmetric matrix with diagonal. For any < e < 1, there 
exists a partition of{l, n} into k subsets a±, .., a*; such that 



k < 



2 log(n) 
(y/2- 1)% 2 



and for any i ^ k, 



P. TP* 



4e\\T\ 



Proof. As before denote A = T + ||T||. Id and [/ = A*. Note [/ 



||T||2 



r the standardized 



matrix. Applying Corollary 14.51 we have a column partition for which we do on each block as 
we did in the previous proposition. The result follows easily. □ 



Acknowledgement : I am grateful to my PhD advisor Olivier Guedon for his constant en- 
couragement and his careful review of this manuscript. 
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